SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT I, MANABU KOMATSU, a 
citizen of Japan residing at: Tokyo, Japan have 
invented certain new and useful improvements in 

METHOD AND APPARATUS FOR PROCESSING IMAGE SIGNAL AND 

COMPUTER-READABLE RECORDING MEDIUM RECORDED WITH 
PROGRAM FOR CAUSING COMPUTER TO PROCESS IMAGE SIGNAL 

of which the following is a specification:- 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention generally relates to 
methods and apparatuses for processing an image signal 
5 and computer-readable recording media recorded with a 
program for causing a computer to process an image 
signal, and more particularly to a method and an 
apparatus for processing an image signal and a computer- 
readable recording medium recorded with a program for 
10 causing a computer to process an image signal, which 

relate an input image to a type of a drawing object in 
order to output an image of high quality. 

2 . Description of the Related Art 

In a conventional image processing method, 
15 image data is input from a scanner or a host computer; 
output color elements C (Cyan) , M (Magenta) , Y (Yellow) 
and K (blacK) , which are control signals of an image 
forming apparatus such as a color copier or the like, 
are processed by a uniform color conversion; and then 
20 the image data is output from the image forming 

apparatus such as the color copier or the like. In this 
conventional method, it is difficult to reproduce an 
optimized color of a compound document which document is 
displayed on a monitor of the host computer. 
25 For example, different types of objects are 
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combined by a page description language so that a 
compound document including both a monochrome photograph 
and a color photograph, a graphic image and text can be 
created. However, when the color conversion is 
5 conducted on the compound document based on a picture 
output, a text or a graphic image becomes a pale color 
with less impact. On the other hand, when a color of 
the compound document is reproduced with a strong 
saturation corresponding to a business graphic, a 

10 photograph color is deteriorated and a color selected as 
a background color is reproduced at high density. 
Consequently, characters on the background color are not 
clearly visible or easily readable. 

Methods that solve the above problems are 

15 described, for example, in the Japanese priority 
applications No. 9-282471 and No. 9-193477. 

In the Japanese priority application No. 9- 
282471, based on an image type (character data, graphic 
data or raster graphic data) in the page description 

20 language, a characteristic of each pixel is determined. 
Also, technologies for conducting processes, which 
influence a print quality, such as a middle tone process, 
a gamma correction, a filter process and a masking 
process, are described. Thus, according to the 

25 invention described in the Japanese priority application 
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No. 9-282471, it is possible to control an image output 
signal based on the image type and to output an image of 
high-grade quality. 

In addition, in the Japanese priority 
5 application No. 9-193477, a color printer is described in 
which print data is referred to, an attribute related to 
color correction for each object is determined and a 
color correction function corresponding to the 
determined attribute is selected. Thus, according to 

10 the invention described in the Japanese priority 
application No. 9-193477, each object type is 
automatically determined and the color correction is 
conducted for each object. 

The color correction in the invention in the 

15 Japanese priority application No. 9-193477 will be now 
described. 

In general, a color reproduction range of an 
electronic picture or inkjet printer is narrower than 
that of a television set, a CRT display or the like. 

20 Thus, various color correction technologies have been 
proposed for correcting a difference between the color 
reproduction range of an input color image and that of 
an output color image. The color correction 
technologies are always required for a color image 

25 output apparatus if it has a limited the color 
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reproduction range . 

Regarding the color correction, further 
methods that solve the above problems are described, for 
example, in the Japanese priority applications 
5 No. 4040072 and No. 7-327141. 

In a color correction method described in the 
Japanese priority application No. 4040072, it is 
determined whether or not a desired color in a uniform 
color space or an HVC color space (a color space 

10 consisted of information of brightness, hue and 

saturation) is out of the color reproduction rage for an 
output image. That is, when the desired color is out of 
the color reproduction rage for an output image, a 
saturation having the same brightness and hue as the 

15 desired color is corrected to be a maximum value and 
then the image is output. 

Moreover, in a color image signal processing 
method described in the Japanese priority application 
No. 7-327141, a brightness component is compressed in 

20 accordance with a reproduction brightness ratio of an 
input system to an output system and then a saturation 
component is compressed and converted into color image 
data within the color reproduction range of the output 
image . 

25 However, in the inventions described in the 
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Japanese priority applications No. 9-282471 and No. 9- 
193477, the image output signal is controlled by the 
image type alone. That is, an object color is 
controlled regardless of a background color. Thus, an 
5 unbalance between the object color and the background 
color still remains. 

Consequently, the above inventions have a 
disadvantage in that characters on the background color 
are not clearly visible and easily readable. 

10 Also, according to the inventions described in 

the Japanese priority applications No. 4040072 and No . 7- 
32714, the color correction is controlled regardless of 
the background color. Thus, the color correction is not 
properly conducted relative to the background color. 

15 Consequently, these inventions have a 

disadvantage in that characters on the background color 
are not clearly visible and easily readable. 

SUMMARY OF THE INVENTION 

20 It is a general object of the present 

invention to provide methods and apparatuses for 
processing an image signal, and computer-readable 
recording media recorded with a program for causing a 
computer to process an image signal, in which the above- 

25 mentioned problems are eliminated. 
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A more specific object of the present 
invention is to provide a method and an apparatus for 
processing an image signal, and a computer- readable 
recording medium recorded with a program for causing a 
5 computer to process an image signal, in which, based on 
an image type and background information, an image 
output signal and a color correction are controlled so 
as to obtain a compound document in which characters and 
line drawings on the background color are clearly 
10 visible. 

The above objects of the present invention are 
achieved by a method for processing an image signal, in 
which method input image information for an input image 
is converted into an image forming controlling signal 

15 for an image forming apparatus, the method including the 
step of: (a) controlling a conversion from the input 
image information into the image forming controlling 
signal based on a type of a drawing object for the input 
image and background information for a background where 

20 the drawing object is formed. 

According to the above invention, it is 
possible to provide a method in which a compound 
document, in which characters and line drawings on the 
background color are clearly visible and easily readable, 

25 can be output. 
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The above objects of the present invention are 
achieved by an apparatus for processing an image signal, 
in which apparatus input image information for an input 
image is converted into an image forming controlling 
5 signal for an image forming apparatus, the apparatus 

including: an object type determining part determining a 
type of a drawing object for an input image; a 
background color information extracting part extracting 
background information for a background where the 

10 drawing object is formed; and a controlling part 
controlling a conversion from the input image 
information into the image forming controlling signal 
based on the type of the drawing object and the 
background information. 

15 According to the above invention, it is 

possible to provide an apparatus in which a compound 
document, in which characters and line drawings on the 
background color are clearly visible and easily readable, 
can be output. 

20 The above objects of the present invention are 

achieved by a computer-readable recording medium 
recorded with a program for causing a computer to 
process an image signal, in which computer input image 
information for an input image is converted into an 

25 image forming controlling signal for an image forming 
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apparatus, the program including the codes of: (a) 
determining a type of a drawing object for the input 
image; (b) extracting background information for a 
background where the drawing object is formed; and (c) 
5 controlling a conversion from the input image 

information into the image forming controlling signal 
based on the type of the drawing object and the 
background information . 

According to the above invention, it is 

10 possible to provide a computer-readable recording medium 
recorded with a program for causing a computer to 
process an image signal in which a compound document, in 
which characters and line drawings on the background 
color are clearly visible and easily readable, can be 

15 output. 

BRTEF DESCRIPTION OF THE DRAWINGS 

In the following, embodiments of the present 
invention will be described with reference to the 
20 accompanying drawings. 

FIG.l is a diagram showing an image output 
controlling apparatus according to a first embodiment of 
the present invention; 

FIG. 2 is a diagram for explaining a color 
25 conversion; 
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FIG.3 is a diagram for explaining a background 
color extracting part; 

FIG. 4 is a diagram for explaining a color 
converting part; 
5 FIG. 5 is a flowchart for explaining an image 

processing method executed by an image output 
controlling apparatus; 

FIG. 6 is a diagram showing a concrete 
configuration of an information processing system for 
10 the image processing system; 

FIG. 7 is a block diagram of a color correcting 
apparatus according to a second embodiment of the 
present invention; 

FIG.8A and FIG.8B are diagrams for explaining 
15 a color correction; 

FIG. 9 is a flowchart for explaining a color 
correcting part; and 

FIG. 10 is a flowchart for explaining a color 
correcting process executed by a color correcting 
20 apparatus. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[FIRST EMBODIMENT] 

FIG.l is a diagram showing an image output 
25 controlling apparatus according to a first embodiment of 
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the present invention. The image output controlling 
apparatus corresponds to the image signal processing 
apparatus in the claims . 

In FIG.l, a computer 101 controls an image 
5 output controlling apparatus 200. When the computer 101 
receives an output instruction from an operator, the 
computer 101 sends a set of image data for a compound 
document such as image data input by image pickup, both 
a monochrome picture and a color picture edited by a DTP 

10 (DeskTop Publishing) software, a graphic image, and a 
text, to the image output controlling apparatus 200. 
The image output controlling apparatus 200 analyzes the 
image data sent from the computer 101, converts input 
image information into control signals such as output 

15 color elements C (Cyan) , M (Magenta) , Y (Yellow) and K 
(blacK) , and transmits the control signals to an image 
forming apparatus (printer) 301 such as a color copier 
or the like. In the image forming apparatus 301, a 
transmitted image based on the control signals is output 

20 (printed) . 

The image output controlling apparatus 200 may 
be mounted in the image forming apparatus (printer) 301 
and conduct a color conversion. Otherwise, the image 
output controlling apparatus 200 may be mounted in the 
25 computer 101. 
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Alternatively , the image output controlling 
apparatus 200 may be mounted in a printer controlling 
apparatus that is provided separately independent of the 
image forming apparatus (printer) 301, and conduct the 
5 color conversion and then send converted color 

information to the image forming apparatus (printer) 301. 

Moreover, the embodiment can be realized by 
software. In this case, a printer driver resident in 
the computer 101 as a program may execute the above 
10 processes. 

The output controlling apparatus 200 includes 
at least an object type determining part 201; a color 
converting part 202 for converting input image data into 
the control signals for the image forming apparatus 301, 

15 the control signals corresponding to a drawing object 
type and background information for forming a drawing 
object thereon; a background color information 
extracting part 203 for extracting color information of 
a background on which the drawing object is formed; a 

20 drawing part 205 for developing a print image (image 
data) and conducting a synthesizing process, a y - 
conversion process and a middle tone process in 
accordance with a drawing instruction described by a 
page description language (PDL) or the like; and an 

25 image storing part (storage buffer) 206 for temporarily 
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storing the print image for one or more pages drawn by 
the drawing part 205. 

The image output controlling apparatus 200 may 
include the color converting part 202 for obtaining a 
5 print output egual to a display image based on 

characteristics of an image displaying apparatus and a 
printer, and a resolution converting part for converting 
into a resolution corresponding to each machine type. 

In this embodiment, in detail, the image data 

10 to be input into the image output controlling apparatus 
200 is contrast data of RGB (Red, Green and Blue) . 
Generally, a contrast for each color element is 
indicated by 8 bits = 256 grades. However, any number 
of contrast grades, such as 64 or 512 grades, can be 

15 used. 

Operations of the image output controlling 
apparatus 200 will now be described. The object type 
determining part 201 receives the image data for a 
compound document and then recognizes the drawing object 

20 type (character code, graphic code or raster graphic 

data) and its attributes (type, size, color, thickness 
and the like) . Subsequently, the object type 
determining part 201 determines whether or not to 
control the color conversion and then sends the image 

25 data to the color converting part 202 and the background 
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color information extracting part 203 based on the 
determination result. 

The input image data is directly transmitted 
from the object type determining part 201 to the color 
5 converting part 202. In the color converting part 202, 
for example, the image data such as an image object or a 
painted graphic is converted into the output color 
elements C, M, Y and K, which are the control signals of 
the image forming apparatus (printer) 301, so as to 

10 correspond to an image display by the color conversion 
based on characteristics of the image display apparatus 
and the image forming apparatus (printer) 301, which 
apparatuses are used by a user. 

The color conversion, from each contrast data 

15 of RGB (Red, Green and Blue) into each data of the 

output color elements C, M, Y and K, converts into CMYK 
data by a memory map interpolation. 

In the memory map interpolation, as shown in 
FIG. 2, in a case in which the RGB space is defined as an 

20 input color space, the RGB space is divided into solid 
graphics (cubes in this case) of the same type. To 
obtain an output value (converting each data into the 
output color elements C, M, Y and K) at an input point 
P (RGB) , a cube including the input point is selected and 

25 then a linear interpolation is conducted based on 
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predetermined output values on vertices of the selected 
cube and a position (distance from each vertex) of the 
input point in the cube. 

In FIG. 2, the input point P (RGB) and an output 
5 value (C (RGB) , M (RGB) , Y (RGB) ) are related to each other 
by an interpolation operation. By changing the 
interpolation operation based on the drawing object type, 
even the same point P (RGB) can be converted into a 
different output value (C (RGB) , M ( RGB ) , Y ( RGB ) ) . 

10 In the first embodiment, three factors of the 

output value correspond to three values of the color 
elements C, M and Y, respectively. In the RGB- 
coordinates used for the interpolation operation, a 
relationship (L*a*b*-CMY) between an actual input and an 

15 actual output is measured and then RGB (L*a*b*) is 
calculated by the least squares method using the 
measured data. Then, values of the output elements C, M 
and Y are predetermined to correspond to the calculated 
RGB (L*a*b*) . 

20 Also, the control signals C, M and Y are 

converted into the control signals C, M ' , Y ' and K by 
for example the following operations : 
K = a X min(C,M,Y) 
C = C - 0 X K 
25 M ' = M — ft X K 
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Y' = Y - ]8 X K (1) . 

It should be noted that the color conversion 
is not limited to the above method. The control signals 
C, M and Y may be directly converted into the control 
5 signals C, M' and Y'. 

Also, for example, the computer 101 may store 
the characteristics of the image display apparatus in 
header information of the image data and transmit the 
characteristics. In a case in which the image output 
10 controlling apparatus 200 is mounted in the computer 101, 
for example, a device profile standardized by ICC (Inter 
Color Consortium) is read out and used. 

For example, in the background color 
information extracting part 203, information including a 
15 character drawing start address, a character size, a 

character type and the like is extracted and an area on 
which characters are formed is calculated based on image 
data corresponding to character information, which image 
data is transmitted from the object type determining 
20 part 201 to the background color information extracting 
part 203. The area is dependent on the character size, 
the character type or the like. Also, an area location 
is dependent on the character drawing start address. 

In the background color information extracting 
25 part 203, as shown in FIG. 3, the background color 
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information of the calculated area is extracted as an 
average of colors of all the pixels within the area for 
an image developed in the image storing part (storage 
buffer) 206. 

5 A process of the color converting part 202 

will now be described with reference to FIG. 4. In FIG. 4, 
the color converting part 202 includes a color 
conversion table selecting part 401, an interpolation 
operating part 402 and a color conversion table storage 

10 403. The color conversion table storage 403 stores 

tables for various drawing object types such as a photo 
table, a character table A, a character table B, graphic 
table A and so on. The color conversion table selecting 
part 401 in the color converting part 202 refers to the 

15 drawing object (for example, character) type, color 
information (Ri, Gi , Bi) and the background color 
information (Rb, Gb, Bb) from the background color 
extracting part 203; and selects an optimal color 
conversion table from the color conversion table storage 

20 403, which table is sent to the interpolation operating 
part 402. The interpolation operating part 402 refers 
to the selected color conversion table; executes, for 
example, the memory map interpolation as described 
above; and then sends the image data to the drawing part 

25 205. 



-18- 



In the color conversion table selecting part 
401, for example, when the drawing object is a character 
and it is determined that a character color and the 
background color, for which the color conversion is 
conducted, are similarly bright colors, the character 
table A for outputting by colors having the same hue and 
a high density is transmitted to the interpolation 
operating part 402. On the other hand, when it is 
determined that a contrast between the character color 
and the background color, for which the color conversion 
is conducted, is stronger, the character table B for 
outputting colors that are closer to monitor display 
colors is transmitted to the interpolation operating 
part 402. By the above determination, it is possible to 
make a character more visible with respect to the 
background . 

It should be noted that the character table A 
is for the color conversion while the brightness remains 
and the character table B is for the color conversion 
while the saturation remains. 

In the image output controlling apparatus 200 
described above, it is possible to output the compound 
document in which a character or a line drawing on the 
background color is clearly visible for any input image 
information . 
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Also, in FIG. 4, the drawing object color is 
changed based on the object information and the 
background information. However, in the present 
invention, it is also possible to change the background 
5 color based on the drawing object information and the 
background information. In this case, the color 
conversion table storage 403 stores various conversion 
tables for the background. For example, the conversion 
table storage 403 stores a conversion table for a case 

10 of a uniform background, a conversion table for a case 
of a gradation background, or the like. 

FIG. 5 is a flowchart for explaining an image 
processing method executed by the image output 
controlling apparatus 200. In this embodiment, for the 

15 sake of convenience, it is assumed that the drawing 

object is a character. But, any drawing object other 
than the character can be processed in the same method. 

In step SI, image data of a compound document 
or the like is received and the drawing object type 

20 (character code, graphic code or raster graphic data) 
and the content information (type, size, color, 
thickness and the like) are recognized. Color 
difference information AEs between the drawing object 
and the background is set to a predetermined value to 

25 determine whether or not to change the color conversion 
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table . 

In step S2 , it is determined whether or not 
the drawing object is the character information. When 
it is determined that the drawing object is other than 
5 the character information, the process skips to step Sll 
and color conversion using a default color conversion 
table is executed. Then, the process is terminated. 

The default color conversion table is set to 
output image data closer to the monitor display color. 
10 When it is determined in the step S2 that the 

drawing object is the character information, it is 
determined in step S3 whether or not color information 
(R,G,B) of the drawing object is all 0 (zero) or 255, 
that is, whether the color information indicates black 
15 or white. When the color information (R,G,B) is all 0 
(zero) or 255, the process skips to the step Sll and 
color conversion using the default color conversion 
table is executed. Then, the process is terminated. 

When it is determined in step S3 that the 
20 color information (R, G, B) is not all 0 (zero) or 255, 
the drawing start address, the character size, the 
character type and the like are referred to and an image 
area including the background to form the character is 
calculated in step S4. 
25 In step S5 , it is determined whether or not 
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each pixel of a background area in the image area 
obtained in the step S4 is shown by binary data or 
multiple data. 

In the step S5 , for example, when it is 
determined that the background in the image area for 
drawing the drawing object is shown by the multiple data, 
each of the color elements R, G and B within the 
background of the image area is averaged and each of 
average values Rave, Gave, Bave is obtained in step S6. 
And then, for example, L*a*b* that shows a color in the 
uniform color space is calculated by the following 
expressions : 

X = 0.4124XR + 0.3575XG + 0.1805XB, 
Y = 0.2126XR + 0.7152XG + 0.0722XB, 
Z = 0.4124XR 4- 0.1192XG + 0.9505XB (2). 

L* = 116(Y/Y 0 ) 1/3 - 16 (Y/Y 0 > 0.008856), 

a* = 500 [ (X/X 0 ) 1/3 - (Y/Y 0 ) 1/3 ] 

(X 0 , Y 0 and Z 0 are values of 
a reference reflection surface) , 
b* = 200 [ (Y/Y 0 ) 1/3 - <Z/Z 0 ) 1/3 ] (3). 
It should be noted that the above operations 
convert into L*a*b*, which is color information in the 
uniform color space, so as to be suitable for human 
visual sense. 
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Also, in a case of the color elements R, G and 
B, when the background is painted, an average 
chromaticity value can be calculated directly from the 
color elements R, G and B. On the other hand,, when the 
5 background is a gradation, the average chromaticity 
value of the entire background can be calculated by 
obtaining an average of a changing direction of the 
chromaticity . 

In step S7 , when it is determined in the step 

10 S4 that the background in the image area where the 

drawing object is drawn is indicated by binary data of 
the color elements C, M, Y and K (that is, when the 
input image is converted into control signals for 
forming an image) , a pixel number is counted for each 

15 color element. Then, the pixel number for each color 

element is divided by a total pixel number of the image 
area and then the pixel number for each of color 
elements C, M, Y and K per area unit is obtained. For 
example, values of L*a*b* are presumed by a color in the 

20 uniform color space based on the pixel number as an 

appearance frequency of the color element in step S7. 

In step S8, a color difference AE between the 
background color components Lh, ah and bh calculated in 
the step 6 or the step 7 and the drawing object color 

25 components Lo , ao and bo is obtained by the following 
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expression : 

AE = [ (Lh - Lo) 2 + (ah - ao) 2 + (bh - bo) 2 ] 1/2 (4). 
In step S9, the color difference AE 
calculated in the step S8 is compared with the color 
5 difference information AEs between the drawing object 
color and the background color which information is 
calculated in the step SI. When the calculated AE is 
greater than the predetermined AEs, the process skips 
to the step Sll and the color conversion using the 
10 default color conversion table is executed. Then, the 
process is terminated. 

On the other hand, when the calculated AE is 
less than the predetermined AEs, in step S10, a optimum 
color conversion table is selected based on conditions 
15 obtained in the above steps. 

In step Sll, color conversion using the 
optimum color conversion table selected in the step S10 
is executed. 

In the above method, for example, even if a 
20 part of character information is sent as a graphic image 
because a character decoration or the like is performed 
by application software, the process in accordance with 
the flowchart described in FIG. 5 can be executed. Thus, 
there is no problem such that a part of a character 
25 color is improperly changed. 
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Therefore, according to the first embodiment 
of the present invention, for any input image 
information, it is possible to prevent an objectionable 
and unsuitable color in a text. In addition, it is 
5 possible to output a compound document so that 

characters and line drawings on the background color are 
clearly visible and easily readable. 

FIG. 6 is a diagram showing a concrete 
configuration of an information processing system for 
10 the image processing system. 

In the information processing system, the 
computer 101 as a workstation is connected to the 
printer 301. The computer 101 can realize functions of 
the image output controlling process (the image signal 
15 process) and includes a program-readable apparatus 12, a 
display 13, a keyboard 20 and an operating unit 21. 

In the operating unit 21, a RAM 17 and a ROM 
18 are connected to a CPU 16 executing various commands 
via a bus 22. Also, the bus 22 is connected to a DISK 
20 14 that is a large capacity storage and a NIC 15 for 
communicating with devices through networks . 

The program-readable apparatus 12 is an 
apparatus, for example, a floppy disk drive, an optical 
disk drive, a magneto-optical disk drive or the like, 
25 for reading program codes recorded on a storage medium 
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such as a floppy disk, a hard disk, an optical disk (CD- 
ROM, CD-R, CD-R/W, DVD-ROM, DVD-RAM or the like) , a 
magneto-optical disk, a memory card, or the like. The 
program codes recorded on the storage medium are read by 
5 the program-readable apparatus 12 and then stored in the 
DISK 14. The CPU 16 executes the program codes stored 
in the DISK 14. Thus, the above-described method for 
processing an image signal can be realized. 
Alternatively, in this embodiment, by executing the 
10 program code read by the computer 101, an OS (Operating 
System) , a device driver or the like, that is activated 
in the computer 101, may conduct a part of or the entire 
process. Thus, the above-described method for 
processing an image signal can be realized. 
15 [SECOND EMBODIMENT] 

In a second embodiment, the present invention 
can be realized with or without the first embodiment. 

FIG. 7 is a block diagram of a color correcting 
apparatus according to the second embodiment of the 
2 0 present invention. 

In FIG. 7, the computer 101 controls the color 
correcting apparatus 1200. When the computer 101 
receives an output instruction from an operator, the 
computer 101 send the color correcting apparatus 1200 a 
2 5 compound document including image data input by an image 
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pickup, both a monochrome photograph and a color 
photograph, a graphic image, and text. 

The color correcting apparatus 1200 analyzes 
image data sent from the computer 101. In the color 
5 correcting apparatus 1200, by a color correcting process 
that will be described later, a color indicated in the 
image data is compressed within a color reproduction 
range of the image forming apparatus (printer) such as a 
color copier and then color conversion is performed to 
10 convert the image data into output color elements C 

(Cyan) , M (Magenta) , Y (Yellow) and K (blacK) as control 
signals. Then, the result of the color conversion is 
transmitted to the image forming apparatus 301. 

The image forming apparatus (printer) 301 
15 prints an image based on the result. 

The color correction apparatus 1200 can be 
mounted inside of the image forming apparatus (printer) 
301 or inside of the computer 101. Alternatively, the 
color correction apparatus 1200 can be mounted inside of 
20 a printer controlling apparatus provided independent of 
the image forming apparatus (printer) 301, and the image 
data can be transmitted to the image forming apparatus 
(printer) after the color conversion is conducted. 

Also, this embodiment can be realized by 
25 software. In this case, a printer driver resident in 
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the computer 101 as a program may realize this 
embodiment . 

The color correction apparatus 1200 includes 
at least the object type determining part 201; a color 
5 correcting part 1202 for compressing a color indicated 
by input color image data to within the color 
reproduction range of a printer based on a drawing 
object type and a background color on which a drawing 
object is formed and then mapping the drawing object; 

10 the background color information extracting part 203 for 
extracting color information of a background where the 
drawing object is formed; a color converting part 1204 
for converting a L*a*b* value compressed and mapped 
within the color reproduction range of the printer into 

15 control signals for the printer; a drawing part 205 for 
developing a print image (image data) and conducting a 
synthesizing process, a y -conversion process and a 
middle tone process in accordance with a drawing 
instruction described by a page description language 

20 (PDL) or the like; and an image storing part (storage 

buffer) 20 6 for temporarily storing the print image for 
one or more pages drawn by the drawing part 205. 

In this embodiment, in detail, the image data 
to be input into the image correcting apparatus 1200 is 

25 contrast data of RGB (Red, Green and Blue) . Generally, 



-28- 



a contrast for each color element is indicated by 8 bits 
= 256 grades. But, any number of contrast grades, such 
as 64 or 512 grades, can be used. 

Operations of the image correcting apparatus 
5 1200 will now be described. Similarly to the first 
embodiment, the object type determining part 201 
receives image data of a compound document and then 
recognizes the drawing object type (character code, 
graphic code or raster graphic data) and its attributes 
10 (type, size, color, thickness and the like) . 

Subsequently, the object type determining part 201 
determines whether or not to control a compressing and 
mapping direction toward inside of the color 
reproduction range of the printer and then sends the 
15 image data to the color correcting part 1202 or the 

background color information extracting part 203 based 
on the determination result. For example, when the 
image data is an image object, a painted graphic or the 
like, the image data is sent directly from the object 
20 type determining part 201 to the color converting part 
1204. In the color correcting part 1202, for example, 
L*a*b* in the uniform color space is calculated based on 
a color temperature of a CRT monitor , color coordinates 
and a photoelectric transfer characteristic by the 
25 following expressions: 
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X = 0.4124XR + 0.3576XG + 0.1805XB 

Y = 0.2126XR + 0.7152XG + 0.0722XB 

Z = 0.0193XR + 0.1192XG + 0.9505XB (2) 

L* = 116(Y/Y 0 ) 1/3 - 16 (Y/Y 0 > 0.008856), 

a* = 500 [ (X/X 0 ) 1/3 - (Y/Y 0 ) 1/3 ] 

(X 0 , Y 0 and Z 0 are values of 
a reference reflection surface) , 
b* = 200 [ (Y/Y 0 ) 1/3 - (Z/Z 0 ) 1/3 ] (3). 
It should be noted that the above operations 
convert into L*a*b*, which is color information in the 
uniform color space, so as to be suitable for human 
visual sense. 

In addition, a compressing process for a 
brightness component of input color image signals is 
executed by using the following expression where Lwhite 
(corresponding to Lwp in FIG. 8 (A)) and Lblack 
(corresponding to Lbp in FIG. 8 (A)) denote the highest 
brightness (white point) and the lowest brightness 
(black point) , respectively: 

L* = L* X (Lwhite - Lblack) -r- 100 + Lblack (5) . 
The above expression (5) changes a color, 
which brightness component (L*) is outside of the color 
reproduction range of the printer for input color image 
signals, to a color which brightness component (L*) is 
inside of the color reproduction range of the printer. 
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That is, FIG.8A and FIG.8B show a changing operation of 
a color. 

Moreover, in the color correcting part 1202, 
when a color is still outside of the color reproduction 
5 range of the printer after the above brightness 

compressing process, for example, the color is mapped to 
another color located at the outer most border of the 
color reproduction range of the printer in a color 
difference minimizing direction (corresponding to the 

10 color converting process from a solid line to a dot line 
shown in FIG.8B). In FIG.8A and FIG.8B, the mapping 
from the solid line to the dot line in a horizontal 
direction maintains the brightness. Also, the mapping 
in a vertical direction maintains the saturation. 

15 Actually, for example, in FIG.8B, XI is mapped to X2 at 
a predetermined angle Q . 

In the converting part 1204, the input image 
data, which is compressed in the color correcting part 
1202, is converted into output color elements C, M, Y 

2 0 and K as control signals for the image forming apparatus 
(printer) 301 by the color conversion based on the 
characteristics of the image forming apparatus (printer) 
301 for L*a*b* in the uniform color space. After that, 
the input image data is sent to the drawing part 205 and 

25 the image storing part (storage buffer) 206. 
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In the color conversion in the color 
correcting part 1202, similarly to the first embodiment, 
the memory map interpolation is used. 

Also similarly to the first embodiment, the 
5 image data for character information is sent from the 

object type determining part 201 to the background color 
information extracting part 203. In the background 
color information extracting part 203, a drawing start 
address, a character size, a character type and the like 
10 are extracted and then an area forming a character is 
calculated. 

Also similarly to the first embodiment, in the 
background color information extracting part 203, an 
average color of all the pixels within the area is 
15 output for the image developed in the image storing part 
(storage buffer) 206. 

A process executed by the color correcting 
part 1202 will be now described with reference to FIG. 9. 

An RGB-to-L*a*b* converting part 1401 in the 
20 color correcting part 1202 converts an input color into 
CIEL*a*b*, which is a typical uniform color space, by 
the above expressions (2) and (3) . A brightness 
compressing part 1402 in the color correcting part 1202 
refers to the highest brightness (white point) and the 
2 5 lowest brightness (black point) of the printer and then 
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adjusts the brightness component (L*) of the input color 
image signal to be within the color reproduction range 
of the printer (a process from FIG.8A to FIG.8B) . 

A color compressing part 1403 in the color 
5 correcting part 1202 refers to data in a color 

reproduction range storing part 1404 to determine 
whether or not the drawing object color is located 
outside of the color reproduction range of the printer. 
When it is determined that the drawing object color is 

10 located outside of the color reproduction range of the 
printer, based on the drawing object type (for example, 
a character) , color information (L*a*b*in) , and 
background color information (L*a*b*back) from the 
background color information extracting part 203, that 

15 is, based on for example, a color difference and the 
above color information (L*a*b*in) , a compressing 
direction is determined in a condition of a constant hue 
and a range from the brightness maintaining direction to 
the saturation maintaining direction. Then, the outer 

20 most border color of the color reproduction rage of the 
printer in the compressing direction is selected from 
the color reproduction range storing part 1404 and is 
sent to the color converting part 1204. 

In the color compressing part 1403, similarly 

25 to the first embodiment, the color difference is 
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obtained from the expression (4) . For example, when it 
is determined that the color difference between a 
character color and the background color is small and 
both colors have a similar color brightness, the drawing 
5 object color is mapped to a color in the compressing 
direction for outputting the same hue and high density 
(minimum color difference and maintained saturation) . 
On the other hand, when it is determined that a contrast 
between the character color and the background color is 

10 stronger, the drawing object color is mapped to a color 
in the compressing direction for outputting closer to 
the monitor display color (maintained brightness and 
minimum color difference) . 

To convert a color while minimizing the color 

15 difference and maintaining the saturation is to change 
the brightness of the color while maintaining the hue 
and the saturation. To convert a color while 
maintaining the brightness and minimizing the color 
difference is to change the saturation of the color 

20 while maintaining the hue and the brightness. 

In the color correcting apparatus described 
above, for any input color image information, it is 
possible to output a compound document in which a 
character or a drawing line on the background color can 

25 be clearly visible and easily readable. 
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FIG.10 is a flowchart for explaining a color 
correcting process executed by the color correcting 
apparatus 1200. 

In step S101, the image data of the compound 
5 document is received and color information (RGB) of the 
drawing object is converted into CIEL*a*b*, which is the 
typical uniform color space, by the above expressions 
(2) and (3) . 

In step S102, the highest brightness (white 
10 point) and the lowest brightness (black point) of the 
printer are referred to and the brightness component 
(L*) of the input color image signal is adjusted to the 
color reproduction range of the printer (see FIG.8A and 
FIG. 8B) . 

15 In step S103, the image data of the compound 

document is received, the drawing object type (character 
code, graphic code, raster graphic data) and its 
attributes (type, size, color, thickness and the like) 
are recognized. In step S104, it is determined whether 

20 or not the drawing object is a character. When the 

drawing object is an object other than the character, 
the process skips to step S110. In the step S110, the 
color correction (the color compressing process) is 
conducted in a default color compressing direction for a 

25 color which is outside of the color reproduction range 
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of the printer and then the process is terminated. 

It should be noted that a default color 
compressing direction is a color difference minimizing 
direction so as to output the drawing object with the 
5 closest display color and may be changed based on the 
hue, but is not limited to the above. 

When it is determined that the drawing object 
is the character in step S104, the process goes to step 
S105. In the step S105, information including the 
10 drawing start address, the character size, the character 
type and the like are referred to and then the area 
forming the character is calculated. 

In step S106, similarly to the first 
embodiment, each average of the color elements RGB, CMY 
15 and CMYK is obtained and then L*a*b* in the uniform 
color space is calculated. 

In step S107, the brightness compression is 
conducted based on the expression (5) . 

In step S108, similarly to the first 
20 embodiment, the color difference AE between the color 
components Lh, ah and bh of the background color 
calculated in the step S106 and the step S107 and the 
color components Lo , ao and bo of the drawing object 
calculated in the step S106 and the step S107 are 
25 calculated by the above expression (4) . 
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In step S109, color compression parameters are 
selected from the color difference Ae calculated in the 
step S108, the color components Lo , al and bo of the 
drawing object and the like and changed. Then, the 
5 color compression is conducted in the color compressing 
direction set in the step S110. 

Also, the color compression in the steps S109 
and SI 10 is conducted in a direction where the hue H 
obtained by the following expression (6) is maintained 
10 within a range (the predetermined angle 6 shown in 

FIG.8B) from the brightness maintaining direction to the 
saturation maintaining direction. 

hue H = a*tan2(b*, a*) X 180/ tc 
where H=0 when a=b=0 and H=360+H when H<0 (6) . 
15 According to the method described above, for 

example, even if the character information including 
graphics is sent because character decoration is 
performed by the application software, the process in 
accordance with the flowchart shown in FIG. 10 is 
20 conducted. Therefore, there is no problem such that a 
color of a part of the character is changed to be 
obj ectionable . 

Therefore, it is possible to prevent a 
compound document from including an objectionable color 
25 and also it is possible to output a compound document 
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where a character and a drawing line are clearly visible 
and easily readable. 

Similarly to the first embodiment, the 
information processing system as shown in FIG. 6 can be 
5 configured to realize the image processing system 
according to the second embodiment. A detailed 
explanation of the configuration of the information 
processing system will be omitted. 

According to the present invention, it is 
10 possible to output a compound document in which 

characters and line drawings on the background color are 
clearly visible and easily readable. 

In addition, the background information for 
the drawing object can be evaluated by an average of 
15 background colors in the area where the drawing object 
is formed. 

Therefore, even if the background of the 
compound document is specially decorated such as a 
gradation, picture or the like, the color reproducing 
20 method for a drawing object is properly determined. 

Also, the background information is evaluated 
by a value based on an appearance frequency, as a 
reference, of a single color ' forming image in an area 
where the drawing object is formed. 
25 Therefore, even if background information for 
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the background indicates a CMY signal or a CMYK signal, 
an average of background colors in the background can be 
obtained so as to properly determine the color 
reproducing method for a drawing object. 

5 In addition, when image information for the 

drawing object indicates black or white, the conversion 
to the image forming controlling signal based on the 
background information is not controlled. 

Therefore, it is possible to eliminate an 

10 unnecessary conversion process when image information 
for the drawing object indicates black or white. 

Moreover, when a color difference between 
color information for the drawing object and background 
information in an area where the drawing object is 

15 formed is smaller than a predetermined color difference, 
the conversion into the image forming controlling signal 
based on the background information is controlled. 

Therefore, even if the color difference 
between the color information for the drawing object and 

20 the background information in the area where the drawing 
object is formed is smaller than the predetermined color 
difference, it is possible to output a compound document 
where characters and line drawings on the background 
color are clearly visible and easily readable. 

25 Also, the predetermined color difference is 
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defined based on a character type, a character size, a 
character style, a character color, a line type, a line 
thickness and a part of or the entire line color. 

Therefore, it is possible to properly control 
5 the conversion based on attributes of the drawing object 
such as a character type, a character size, a character 
style, a character color, a line type, a line thickness 
and a part of or the entire line color. 

In addition, a color, in said input image, 
10 located outside of a color reproduction range of said 
color image forming apparatus is corrected to another 
color located inside of the color reproduction range. 

Therefore, it is possible to conduct a proper 
color correction so as to obtain the compound document 
15 where characters and line drawings on the background 
color are clearly visible and easily readable. 

Also, the direction to compress and map a 
color, in said input image, located outside of said 
color reproduction range, is controlled toward another 
20 color located inside of said color reproduction range 
based on the type of the drawing object for said input 
image and the background information where said drawing 
object is formed. 

Therefore, it is possible to conduct a proper 
25 color correction so as to obtain the compound document 
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where characters and line drawings on the background 
color are clearly visible and easily readable. 

In addition, the direction to compress and map 
the color is controlled within a range from a direction 
5 maintaining a hue and a brightness to another direction 
maintaining a saturation. 

Therefore, it is possible to conduct a proper 
color correction so as to obtain the compound document 
where characters and line drawings on the background 
10 color are clearly visible and easily readable. 

Also, the background information indicates an 
average of the background colors in an area where said 
drawing object is formed. 

Therefore, even if the background of the 
15 compound document is specially decorated such as a 

gradation, picture or the like, the color reproducing 
method for a drawing object is properly determined. 

The present invention is not limited to the 
specifically disclosed embodiments, and variations and 
20 modifications may be made without departing from the 
scope of the present invention. 

The present application is based on the 
Japanese priority application No . 2000-022997 filed on 
January 31, 2000, the entire contents of which are 
25 hereby incorporated by reference. 



